Two-stage Model Selection Procedures in Partially Linear Regression. Florentina Bunea and Marten Wegkamp
نویسنده
چکیده
منابع مشابه
Sparsity oracle inequalities for the Lasso
This paper studies oracle properties of !1-penalized least squares in nonparametric regression setting with random design. We show that the penalized least squares estimator satisfies sparsity oracle inequalities, i.e., bounds in terms of the number of non-zero components of the oracle vector. The results are valid even when the dimension of the model is (much) larger than the sample size and t...
متن کاملAggregation and Sparsity Via l1 Penalized Least Squares
This paper shows that near optimal rates of aggregation and adaptation to unknown sparsity can be simultaneously achieved via `1 penalized least squares in a nonparametric regression setting. The main tool is a novel oracle inequality on the sum between the empirical squared loss of the penalized least squares estimate and a term reflecting the sparsity of the unknown regression function.
متن کاملA note on penalized minimum distance estimation in nonparametric regression
The authors introduce a penalized minimum distance regression estimator. They show the estimator to balance, among a sequence of nested models of increasing complexity, the L1–approximation error of each model class and a penalty term which reflects the richness of each model and serves as a upper bound for the estimation error. Une note concernant l’estimation par distance minimale pénalisée e...
متن کاملSpades and Mixture Models
This paper studies sparse density estimation via l1 penalization (SPADES). We focus on estimation in high-dimensional mixture models and nonparametric adaptive density estimation. We show, respectively, that SPADES can recover, with high probability, the unknown components of a mixture of probability densities and that it yields minimax adaptive density estimates. These results are based on a g...
متن کاملSparse Density Estimation with l1 Penalties
This paper studies oracle properties of `1-penalized estimators of a probability density. We show that the penalized least squares estimator satisfies sparsity oracle inequalities, i.e., bounds in terms of the number of non-zero components of the oracle vector. The results are valid even when the dimension of the model is (much) larger than the sample size. They are applied to estimation in spa...
متن کامل